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Abstract. In this paper we study the convergence of the max-consensus 
protocol. Tropical algebra is used to formulate the problem. Necessary 
and sufficient conditions for convergence of the max-consensus protocol 
over fixed as well as switching topology networks are given. 



1. Introduction 

The consensus problem addresses the question of whether it is possible 
to achieve a consensus among agents over a network while communicating 
only with the immediate neighbors. The consensus problem in multi-agent 
or di stributed systems were addressed as early as in mid eighties (|Tsitsiklid . 
1984). The field has been been dormant for a while, w i th sp o radic appear 



1987; Vicsek et al. 



ances of seemingly unrelated publications (| Reynolds 
1995lh until it saw a burst i n the last few year s (IJadbabaie et al 



2003 



Olfati-Saber fc Murravi . 120031 : lOlfati-Saber et all 120071 : iRen et all 120071 ) 
The reason for a renewed interest in the field of consensus is due to the 
applications it finds in decentralized multi-agent coordination missions and 
the recent developments of concrete instances of such systems like wireless 
sensor networks and multiple unmanned aerial vehicles. 

The average or the weighted average consensus of agents over networks, 
where the values of all nodes or agents in the network converges to a 
weighted average of their initial values, is what received wide attention of 
researc hes, and this and various extensions of it h ave been addressed exten- 



sively (|01fati-Saber et all 120071 : IRen et all 120071 ). On the otherhand In a 



max-consensus, every agent in the network, communicating with only the 
immediate neighbors, should converge to a value which is maximum of all 
the initial values of the agents. Max-consensus has applications like de- 
centralized leader selection and detection of faults in large networks. The 
pro blem of max-consensus over a network of fixed topology was addressed 
in (| Olfati-Saber &; Murravi. I2003T). However, as the max operation is not 



linear, its treatment in (Olfa ti-Saber &: Murray! 120031 ) is different from that 
of linear protocols where convergence to consensus is proved through conver- 
gence of matrix products. We propose a different analysis of max-consensus 
protocol by forcing max ope ration to be linear through the use of tropical 
algebra ( Baccelli et al. . 19921 ). By this we can give an analysis of the max- 
consensus protocol akin to the standard method of convergence analysis for 
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line ar consensus protocols, that is, analysis of products of adjacency matri- 
ces ( Jadbabaie et aZ.I . l2003l ) . We also give necessary and sufficient conditions 



for convergence of max-consensus protocol under switching topology. 

The rest of the paper is organized as follows. First, we state the max- 
consensus problem in its standard form. Then, we introduce the max-plus 
or the tropical algebra and thereafter reformulate the max-consensus prob- 
lem. Under this new setting, we analyze the convergence of max-consensus 
protocol over a fixed network and give necessary and sufficient condition for 
this to occur. Then we study max-consensus under switching topologies. 
The necessary and sufficient condition for convergence is given for this case 
also. 



2. Background and Preliminaries 

Let Q = (V, £) be a directed graph (digraph) with nodes V = {1, . . . , N} 
and edges £ C V x V. For a node i G V, let Mi denote the neighbor set of i. 
We have 

Mi = {j:jeV, (j,i)e£}. 

By (j, i) G £, we mean an edge directed from node j to node i (node % 
receives information from node j). We consider graphs with self loops, that 
is, if i 6 V, then G £. Let Xi(k) € R be the value of node i at time 
step k. Then, the max-consensus protocol that we consider, for node i, is as 
follows: 

Xi(k + 1) = max{xj(/c)} , k G Z>o- (2-1) 
j'eA/i 

Now the max-consensus problem can be stated as follows: 

Given a digraph Q = (V, £), does there exist a n G N such 
that for all k > n, Xi(k) = maxj g v{xj(0)} for all i G V? 

That is, the value at each node converges to a value which is equal to the 
maximum of all the initial nodal values. 

The max-consensus problem is nonlinear under usual matrix algebra. 
Hence, we switch to an algebra to 'linearize' the max-consensus problem. 
This will enable us for natural extensions and generalizations like analysis 
of the max-consensus under switching topologies where the underlying graph 
changes with time. The suitable framework for the max-consensus problem 
is the tropical al gebra. Here we give a brief overview of the tropical algebra 
(for details, see ( Baccelli et al . 19921 : Izhakian . 2008)). 



In tropical algebra, we consider a semiring (RU{— oo},ffi,<g>) called the 
tropical semiring with addition and multiplication defined as follows. For 
a, b G R U {— oo}, define a © b = max(a, b) and a <S> b = a + b and one can 
show that (R U {— oo}, ©, <g>) has a semiring structure. (R U {— oo}, ©, <g>) is 
called tropical semiring. The zero element of this semiring is — oo and the 
multiplicative identity is 0. 

For the purpose of analyzing the max-consensus problem, we require only 
a tropical sub-semiring with two elements and — oo. We denote this binary 
tropical sub-semiring as (T, ©, ©), where T = {0, — oo}. 
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3. Problem Reformulation 

We reformulate the max consensus problem using tropical algebra. To- 
wards this, we define the tropical adjacency matrix of a graph as follows. 

Definition 3.1. The tropical adjacency matrix of a graph Q = (V, £) is 
a matrix A G f NxN , where V = {1, . . . , N}, with (i,j) th entry defined as 
follows. 

ifi = j, or G £ 
— oo otherwise. 



Since we consider graphs with self loops, all tropical adjacency matrices 
will have diagonal entries as zeros. 

The tropical linear algebra operations involving matrices and vectors is 
as follows. For tropical adjacency matrices A, B G T NxN and a vector 
x = (xi, ... ,xjf) G M. N , we have 

[A B)ij = aij © bij 

= m&x{aij,bij} (3.2) 



(A®B)ij =0(aa®6y) 
i 

= max{au + kj} (3.3) 

3 

= maxjaj,- + xA, (3-4) 

j 

where ay = (A)ij and by = (-B)y with (-)y denoting the (i, j) th element. 
The max-consensus protocol in Eq. (|2.1|) can now be rewritten using tropical 
algebraic operations as follows. 

Xi(k + 1) = max {xj(k)} 



= max < maxjO + xAk)\, max I— oo + Xj(k)\ > . (3.5) 

If A is the tropical adjacency matrix corresponding to graph Q, then from 
Definition 13.11 and Eq. (|3.5[> . it follows that 

Xi(k + 1) = max{(A)ij + xj(k)} 

j&v 

n 

= ©((^)W®^(*))- 
J'=l 

Using the notation x(fc) = (xi(/c), . . . ,x^(k)) T , we have 

Xj(A; + 1) = (A^x(k)) i , for all i G V. 

With the understanding that by product we mean tropical product, the 
max-consensus problem can be written as 

x(k + 1) = Ax(k) 
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or equivalently 

x(k) = A k x(0), (3.6) 

where x(0) = (xi(0), . . . , xn(0)) t G W 1 is the vector of initial values of 
nodes of Q and by A k we mean A ® • ■ • (8) A. 

k times 



Eq uation (13.61) is, in form, similar to the linear consensus protocol (jOlfati-Saber et al. 



20071 : iRen etaU . l2007f ) and its convergence can be analyzed by looking at 



the behavior of A k for large k. 



4. Convergence Analysis 

Towards deriving the convergence criterion for max-consensus protocol 
we first establish certain key properties of tropical adjacency matrix multi- 
plication. 

Definition 4.1. Given a tropical adjacency matrix A G T NxN , its depen- 
dency graph, denoted as G{A), is a graph (V, £) with V = {1, ... , N} and 
e£ if(A)ji = 0. 

In the sequel, we denote the edge set of the dependency graph Q{A) as 
£{A). We have the following observations. 

Lemma 4.2. Let A,B£ y NxN be tropical adjacency matrices and if any 
one of the following holds 

(1) (j,i)e£(A), 

(2) {j,i)e£(B), and 

(3) 3/ such that (l,i) G £{A) and G £{B) 
then Cij = 0. 

Proof. Case 1: We have dij = as G £(A), and bjj = since it 

is diagonal element. This gives us that ajj + bjj = and therefore from 
Eq. (|4.8p (also using the fact that Cjj G {0, — oo}), we have 

Cij = max{max(oj| + bu), (a« + bjj)} 
ieV\j 

= max{max(ajz + 6y),0} = 0. 
Case 2: Follows from similar arguments as in Case 1. 

Case 3: We have an = as (I, i) G £{A), and b\j = as (j, I) G £(B). 
Therefore an + 6/j = which leads us to the conclusion that c^ = using 
arguments similar to that in Case 1. □ 

Now, we have the following lemma. 

Lemma 4.3. Let A,B£ y NxN be tropical adjacency matrices. Then, C = 
A® B is also a tropical adjacency matrix. Moreover, £{C) 2 £(A) U £{B) 
and if there exists a node I such that G £(A) and (j,l) G £{B), then 
(j,i)e£(C). 
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Proof. Let ay, bij, and be the (i, j) th element of A, B, and C respectively. 
Since C = A ® B, from matrix multiplication rule, Eq. (|3.3p . we get 

N 



Since Oij,bij G {0, — 00} and ({0, — 00}, ©, <g>) is a semiring (that is, closed 
under operations © and ®), from Eq. (|4.7|) we have G {0, —00}. If = 0, 
then G 5(C). 

From Lemma 14.21 and the fact that ^4 and S are tropical adjacency ma- 
trices, it is clear that cu = for all i G {1, . . . , N}. Thus C is a tropical 
adjacency matrix since all its entries belong to T and all the diagonal entries 
are zeros. Also immediate are the other claims of the lemma. □ 

From Lemma [4.3l we observe that the tropical adjacency matrix multipli- 
cation is non- commutative which is inherited from the non-commutativity of 
matrix multiplication. The essence of Lemma 14.31 is that the tropical adja- 
cency matrix multiplication is superadditive with respect to the correspond- 
ing edge sets. Thus from this lemma, we have an immediate observation. 

Proposition 4.4. The entries in the tropical adjacency matrices are not 
altered by adjacency matrix multiplications. Moreover, if A is any adjacency 
matrix AO = OA = 0. 

In the above proposition and sequel, corresponds to tropical adjacency 
matrix with all entries as zeros. An implication of above proposition is that, 
once a consensus is achieved, it becomes independent of the underlying graph 
structure. Thus, using a max-consensus protocol, a consensus, if achieved, 
is achieved in finite time. This is in contrast to other consensus protocols 
(average consensus protocol, for example) where the consensus is achieved 
asymptotically. 

We have the following definitions. 

Definition 4.5. A graph Q = (V, £) is strongly connected if for every i,j G 
V there exists a sequence of nodes (called a path from i to j) in V, i = 
io, ii, . . . , i s = j, such that G £ for I G {1, . . . , s} and s < N — 1. 

Equivalently, in a strongly connected graph, it is possible to start at any 
node and reach any other node by following the directed edges of the graph. 

Definition 4.6. A completely connected graph is a graph in which there is 
a directed edge from every node to every other node. 

The tropical adjacency matrix that corresponds to a completely connected 
graph is the zero matrix 0. The shortest distance/path length from i to j 
is the least number of directed edges to follow from node i to reach node j. 




(4.7) 



1=1 





Definition 4.7. Let dij denote the shortest path length from node i to node 
j in a graph Q = (V, £), where i,j G V. Then, diameter of the graph, 
d = maxjjgv dij. 
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If the graph is not strongly connected, there may not be a path between 
some of the nodes and in that case, we assign a value of oo to the diameter. 

Definition 4.8. For all i,j E V, node j is a p-neighbor of i if the shortest 
path length from node j to i is less than or equal to p. We denote the 
p-neighbor set of i as Mf . 

From the above definition, it follows that A/"/ = Mi and the following 
recursion formula holds 

Vga/T 1 / 

We have the following proposition which immediately follows from the defi- 
nitions of strongly connected graph, diameter of a graph, and the p-neighbor 
set of a node. 

Proposition 4.9. For a strongly connected graph with vertex set V and 
having diameter d, Mf = V for all i € V '. 

For a strongly connected graph Q(A) of diameter d, Q(A d ) is a completely 
connected graph as shown in the proof of the following lemma, which leads 
to the main result. 

Lemma 4.10. Let A E x nxn be a tropical adjacency matrix. If Q(A) is 
strongly connected, then A d = where d is the diameter ofQ(A) 

Proof. Let Qk = Q{A k ) for fceN. Let M} = Mi be the neighbor set of node 
i in Q\. Using a special case of Lemma 14.31 (where B equal to ^4), it follows 
that the neighbor set of node i in Q2 is Mf. Continuing the same argument, 
the neighbor set of node i in graph Qk is M^ . For, k = d, by Proposition 14.91 
we have Qd as a completely connected graph and thus the claim of lemma 
follows. □ 

We have the following necessary and sufficient condition for convergence 
of max-consensus protocol. 

Theorem 4.11. The max-consensus protocol in h2.1\) converges for all ini- 
tial conditions if and only if there exists a k € N such that A k = 0. 

Proof, if: 

If A k = for some k E N, then for alii E V 
Xiik + l) = (^x(O)). 

= max{0 + xi(0),... ,0 + x N (0)} 
= m ax{xj(0)} 

only if: 

Suppose A k has at least one non-zero entry for all k E N. Let this be the 
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(i,j) th entry, that is, {A) i ^ = — oo. So we have 

Xi (k + 1) = max{0 + xi (0), . . . , -oo + Xj(0), . . . ,0 + xtv(0)} 

= max{xi(0), . . . ,Xj_i(0),Xj + i(0), . . . ,xat(0)} 

This means that the node i does not converge to the maximum of all initial 
nodal values if Xj(Q) happens to be the maximum. □ 

The above result is used to prove the following theorem which is the main 
result of this section. 



Theorem 4.12. The max- consensus protocol in \2.1\) converges for all ini- 
tial conditions if and only if Q(A) is strongly connected. 

Proof, if: 

If Q(A) is strongly connected, from Lemma I4.1UI we have that A d = and 
thus using Theorem 14.111 it follows that a consensus is achieved in d time 
steps. 
only if: 

We use t he fact that if Q(A) is not str ongly connected, then A is reducible 
(|Fiedlerl . 120081 : iBrualdi fe RvseiL Il99ll ). That is, there exist a permutation 
cr of the numbering of nodes in V such that the resultant adjacency matrix 
6A& T is of the form 

" An [-oo] 
A\2 A22 



where & is the permutation matrix (jBrualdi Sz Rvserl . Il99ll ) corresponding 
to cr, Ai and A2 are square matrices that are non- vacuous (dimension greater 
than or equal to 1), and [—00] is a matrix of appropriate dimension with all 
entries as —00. 

Claim 4.13. There exist no k G N such that, for a matrix A of above form, 
A k = 



Proof. T his follows from the tro pical matrix multiplication of irreducible 
matrices ( Brualdi &: Rvser . 199ll ). In fact, such matrices retains above form 
after multiplication. □ 



Thus if Q{A) is not strongly connected, then there does not exist a k € N 
such that A k = and thus a max-consensus is not achieved. □ 



5. Switching Topology 



Now, we look at the case of switching topology where the underlying 
graph changes during each time step. We consider a consensus protocol of 
the form 

x(fc + 1) = A k x(k) (5.9) 

where A^ 6 Y NxN is a tropical adjacency matrix for k € Z>o- Equivalently, 
we have 

x(fc + 1) = A k A k _ x ■ ■ ■ A x(0) 

Theorem 5.1. The consensus protocol in \5. 9\) converges for all initial con- 
ditions if and only if there exist a k € N such that A^A^i ■ ■ ■ Aq = 0. 
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Proof. Proof is similar to that of Theorem 14.111 where A k is replaced by 
A k A k _ x ---A Q . □ 

If Ak is drawn from a finite set {Ai,A2, ■ ■ ■ ,A m } of tropical adjacency 
matrices, an interesting question to ask is 

Does there exist a finite sequence i±, 12, ■ ■ ■ , i n with 1 < i r < 
m and r € {1, . . . , n] such that the system in Eq. (|5.9[) con- 
verges in n time steps? 

Before answering that we give the following useful definition. 

Definition 5.2. The graphs Gi(V, £1), . . . , G m (V, £ m ) with adjacency ma- 
trices Ai , . . . , A m are called jointly strongly connected if the union graph 
G{A\ © • • • A m ) = \J™ = iG r , with vertex and edge set as (V,\J™ =1 £ r ), is 
strongly connected. 

Proposition 5.3. Let A,B<E y NxN be tropical adjacency matrices. Then 
the graph Q{A® B) is strongly connected if and only if Q{A) and Q{B) are 
jointly strongly connected. 

Proof, if: 

Follows from the superadditivity property of the tropical adjacency matrix 
multiplication proved in Lemma 14.31 
only if: 

Follows from Claim 14.21 in the proof of Lemma 14.31 The claim is actually 
'if and only if although the 'only if part is not required for Lemma 14.31 
In fact, the three ways in which Cij can become zero (refer to Claim 14. 2\i 
are the only ways in which it will be zero. As far as strong connectivity is 
concerned, condition 3 in Claim I4T21 is immaterial because reachability of a 
node is only what matters for strong connectivity in which case the third 
condition is just redundant. Thus, the strong connectivity of Q{A g> B) is 
same as that of Q(A){JQ(B). □ 

Thus, if the graphs corresponding to the tropical adjacency matrices 
{A\, . . . ,A m } are jointly strongly connected, then (Ai (g) ■ ■ ■ (g) A m ) n = 
for some n £ N. Following theorem is the answer to the question of conver- 
gence of max-consensus protocol under switching topology (Eq. (|5.9p ). 

Theorem 5.4. Given a finite set of tropical adjacency matrices {j4i, . . . , A m } C 
Y NxN , there exists a finite sequence A^, . . . , A; Ln with 1 < i r < m for all 
r = {1, . . . ,n} such that the system in Eq. \5. 9\) with A k € {A±, . . . ,A m } 
attains consensus for all initial conditions if and only if Q[A\)^ . . . ,£/(^4 m ) 
are jointly strongly connected. 

Proof. Follows by extending the result of Proposition 15.31 to finite case and 
proceeding in the similar lines of proof of Theorem 14.121 □ 



The above theorem has a couple of interesting corollaries. We give the 
following definition towards this. 
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Definition 5.5. Given a finite set of matrices {A±, . . . ,A m }, the matrix 
mortality problem asks the following question: Does there exist a finite se- 
quence ii,...,i n with 1 < i r < m and r £ {1, . . . , re} such that A^ , . . . , Ai r = 
0? 

The matrix mortality p roblem i s of g reat interest to the theoretical com- 
puter science community ( Sipser . 20061 ). The matrix mortality problem is 



usually undecidable, that is, there does not exist an algorithm which can 
find such a sequence given a matrix set as input. 

Corollary 5.6. // the finite set of input matrices {A\, . . . , A m } are tropical 
adjacency matrices, then the matrix mortality problem is decidable. More- 
over, this can be done in polynomial time. 

From Theorem 15. 4| we know that the matrix mortality problem has a 
positive answer if and only if A%, . . . , A m are jointly strongly connected. In 
that case, the zero matrix is obtained as (A\ (g> • • • A m ) n for some finite 
re € N. Another interesting corollary is as follows. 

Corollary 5.7. The semigroup (under binary operation <g> which is associa- 
tive) generated by the tropical adjacency matrices {A\, . . . , A m } C T NxN 
contains if and only if UJJLj Q{A r ) is strongly connected. 

The following remarks are in place. 

A much more stronger result on the convergence of the max-consensus 
protocol can be achieved if the condition in our theorems 'achieves consensus 
for all initial condition' is relaxed. In particular, a system x(/c + l) = Afcx(0) 
achieves consensus for a particular input x(0) at time step k + 1 if and only 
if there exists a vector y G such that A^y = 0, where 

if Xi (0) = maxj Xj (0) 
— oo otherwise 



in 



In other words, if node i has a maximum initial value, the necessary and 
sufficient condition for a max-consensus to occur at the (k + l) th time step 
is that all elements in the i th column of A k are zeros or equivalently, the 
graph Q(A k ) has a directed spanning tree rooted at node i. 

In the case of the max-consensus protocol, if a consensus occurs, it will 
happen in a finite number of steps. This should be contraste d with the as- 



ymptotic convergence of weighted average consensus protocols fjOlfati-Saber et al. 



2007 : Ren et al . 20071 ). This property enables us to give a stronger conver 



gence criterion. In fact, we gave the necessary and sufficient condition for 
convergence under switching topology. However, this is difficult in general 
for the weighted average consensus case as one has to consider infinite prod- 
uct of matrices (as opposed to product of finite number of matrices in the 
max-consensus case) while analyzing convergence. Thus, in case of weighted 
average consensus, one is forced to impose stronger requirements on the ma- 
trices to achieve convergence of the infinite matrix products. This will, in 
general, result in obtaining only a sufficiency condition for convergence. 

A max-consensus, scheduled at regular intervals, over large networks 
can be used to detect network faults. This is practical as most of the 
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naturally occurring net works like random netwo rks ( Erdos Renvi . 1960), 



small world networks (IWatts &: Strogatz . 19981 ). and scale free networks 



( Barabasi Albert , 1999 ) usually have very small diameters ( Newman et all 
20061). Since the number of time steps for max-consensus algorithm to 
converge is equal to the diameter of the underlying network, consensus is 
achieved fast in these networks due to the 'small diameter property'. A fail- 
ure to attain consensus in the specified time is a indication to the presence 
of a network fault. 

The matrix operations in the semiring (T, max, +) is exactl y same as 
the m atrix operations in the boolean semiring ({0,1}, OR, AND) (|Hammeri . 
19681 ) as there is a ring- isomorphism between these two semirings ((T, max, +) 
is isomorphic to ({0, 1}, OR, AND)). Thus, although the max-consensus 
problem cannot be posed using boolean semiring, all the matrix multipli- 
cation properties used to prove co nvergence can b e identically obtained by 
working in boolean semiring (See ( Hammer . 1968) for properties of boolean 
adjacency matrix multiplication). 



6. Concluding Remarks 

We analyzed the convergence of max consensus protocol with both fixed 
and switching topologies. The observation that tropical algebra gives a 
natural way to formulate this problem enabled an analysis of the conver- 
gence in terms of tropical matrix products which could be easily extended 
to switching topology case. We gave the necessary and sufficient condition 
for max-consensus to occur in fixed as well as switched topology networks. 
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